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[57] ABSTRACT 

A secondary packetized data stream, such as a commercial, 
is spliced with a primary packetized data stream, such as a 
network television program. The system does not require 
decompression of the data in the primary data stream, and is 
particularly suitable for use at a cable system headend to 
allow the insertion of commercials from local businesses 
into a nationally broadcast television program. When a start 
signal is received, a pre-splicing packet of the primary 
stream is determined. The pre-splicing packet is the packet 
closest to the start time which carries an anchor frame (e.g., 
I or P frame) start code. To prevent a potential discontinuity 
at the decoder, the pre-splicing packet is processed to discard 
the anchor frame data, and to insert a number of stuffing 
bytes which is equal to the number of bytes discarded into 
an adaptation field of the pre-splicing packet. To further 
maintain continuity at the decoder, identifying data of the 
primary stream such as PED and PSI data, is retrieved and 
provided to the secondary stream. A number of null packets 
are inserted into the output stream at the transition point 
between the main program and the commercial to prevent a 
buffer overflow at a decoder which receives the output 
stream. 

29 Claims, 14 Drawing Sheets 
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SPLICING COMPRESSED PACKETIZED 
DIGITAL VIDEO STREAMS 

BACKGROUND OF THE INVENTION 

The present invention relates to the communication of 
digital video signals, and more particularly, to the insertion 
of digital video messages such as commercials into a pre- 
existing compressed packetized data stream. Data packets of 
the commercial message are spliced into a pre-existing data 
stream (complying, e.g., with the Moving Picture Experts 
Group (MPEG) transmission standard) without decompress- 
ing the data in the data stream, and while maintaining 
compliance with the MPEG or similar digital data commu- 
nication protocol. 

Digital transmission schemes are particularly advanta- 
geous for signals that are broadcast from a main office by 
satellite to a cable television affiliate at a system headend. At 
the system headend, the digital data stream may be further 
processed and distributed to the cable system customers, for 
example, via a Hybrid Fiber Coax (HFC) or Fiber to the 
Curb (FTTQ network. Such an arrangement is known as an 
end-to-end digital network since digital video is compressed 
and transmitted from a programming source at a central 
office all the way to each customer's home. In an HFC 
network, a distribution line includes both a coaxial cable 
which carries radio-frequency signals, and an optical fiber 
which carries light wave signals. In a FTTC network, an 
optical fiber carries the data stream from the cable system 
headend to a neighborhood transfer point, or drop, and 
conventional coaxial cable carries the signal from the drop 
to the customer's home. At the customer's home, a decoder 
processes the digital signal to provide a signal for display on 
a television or other display device. 

In such cable distribution systems, the received data 
stream may be processed at the headend prior to distribution 
to the system customers. In particular, commercial messages 
from local businesses may be inserted into the main pro- 
grams. However, in order to accomplish this, conventionally 
the received digital data stream must be completely 
demodulated, demultiplexed, decrypted, decompressed and 
decoded to recover the signal in the analog domain. Then, 
the desired commercial message is provided in the analog 
domain and inserted into the signal to provide a new analog 
combined signal. Finally, the analog combined signal is 
digitized, encoded, compressed, encrypted, multiplexed and 
modulated for transmission to a customer's home. As can be 
seen, this process leaves much to be desired as it requires a 
number of time-consuming steps that must be implemented 
with additional hardware, including magnetic tape recorders 
and players. Moreover, a large magnetic tape library must be 
maintained and indexed. Furthermore, the conversion from 
digital to analog and back to the digital domain may result 
in degradation of the signal quality. 

Thus, it would be desirable to provide a system for 
allowing an auxiliary compressed digital signal such as a 
commercial message to be inserted into a compressed digital 
signal of a main program without requiring decompression 
of the data in the main program signal. Such a system should 
allow cable system headed operators to conveniently insert 
commercial messages into a main program which is 
received, for example, via a nationwide or international 
satellite distribution network. Additionally, the system 
should not degrade the quality of the main program. In 
particular, the system should avoid any discontinuity which i 
results in a non-compliant data stream. The system should 
also preclude problems such as syntax violations, decoding 
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errors, buffer overflow or underflow, timing recovery prob- 
lems due to discontinuous system time stamps, audio/video 
synchronization problems, and video display artifacts. 
Furthermore, the system should be compatible with MPEG 
5 and similar digital data communication standards, in addi- 
tion to being fully compatible with existing decoder tech- 
nology. The present inveotion provides a system having the 
above and other advantages. 

1D SUMMARY OF THE INVENTION 

In accordance with the present invention, a method and 
apparatus are presented for splicing a secondary packetized 
data stream, such as a commercial, with a primary pack- 
etized data stream, such as a network television program. 

15 Advantageously, the system does not require the decom- 
pression of the data in the primary data stream, and is 
particularly suitable for use at a cable system headend. 
A start signal is provided to indicate the time to initiate the 

M splicing, that is, when to insert the commercial. The start 
signal may be embedded as data in the main program, in 
which case it must be recovered. Alternatively, the cable 
system operator may provide an external time signal. In 
either case, once the start signal has been received, a 

ls pre-splicing packet of the primary stream is determined. 
Normally, the pre-splicing packet is the packet closest to the 
start time which carries an anchor frame start code. The 
anchor frame start code indicates that data of an I or P frame 
is carried in the packet. Typically, such a packet may carry 

$Q data from the I (or P) frame, and the frame which immedi- 
ately precedes the I (or P) frame. To prevent a potential 
discontinuity at the decoder, the pre-splicing packet is 
processed to discard the anchor frame data, and to insert a 
number of stuffing bytes which is equal to the number of 

t5 bytes discarded into an adaptation field of the pre-splicing 
packet. An adaptation field is created if it does not already 
exist. 

Additionally, to maintain continuity at the decoder, iden- 
tifying data of the primary stream such as PID and PSI data, 
40 is retrieved and provided to the secondary stream. 

Furthermore, it may be necessary to insert a number of 
null packets into the output stream at the transition point 
between the main program and the commercial. In 
particular, a number L of null packets are provided in the 
45 output stream to prevent a buffer overflow at a decoder 
which receives the output stream. The null packets are 
inserted between the pre-splicing packet of the main pro- 
gram and the first packet of the commercial. Similarly, when 
there is a transition back from the commercial to the main 
50 program, additional null packets may be inserted. The num- 
ber L is determined according to the data rates of the primary 
and secondary streams, and provides a corresponding pad- 
ding delay time which reduces the decoder's buffer level. 
Also, at the transition back from the commercial to the 
55 main program, a post -splicing packet of the main program 
which follows the pre-splicing packet is determined. 
Typically, the post-splicing packet will have a sequence start 
code which follows the sequence end code which is asso- 
ciated with the last packet of the commercial. The post- 
60 splicing packet is positioned to follow the last packet of the 
commercial in the output stream. Moreover, processing of 
the post-splicing packet is analogous to processing of the 
pre-splicing packet. Specifically, data in the post-splicing 
packet which is associated with an immediately preceding 
55 packet, which may or may not be the same as the pre- 
splicing packet, is discarded to prevent a discontinuity at the 
decoder. Moreover, an amount of stuffing data is added to an 
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adaptation field of the post-splicing packet based on the FIGS. 14a and 146 show a post-splicing data packet 
amount that was discarded. An adaptation field is created if having no adaptation field or PES header before and after 
it does not already exist. processing in accordance with the present invention. 

" ^ Pr °- . DETAILED DESCRIPHON OF THE 

INVENTION 

A decoder is also presented for decoding a transport data 
stream which comprises a main program and a commercial. A method and apparatus are presented for splicing a 
The decoder includes a buffer for storing the transport data. secondary packetized data stream, such as a commercial, 
The buffer has a size that is modeled at the insertion with a primary packetized data stream, such as a network 
processing unit by a virtual buffer scheme. A processor is 10 television program. 

coupled to receive data from the buffer for processing to FIG< \ ^ a block diagram of a Fiber-to-the-Curb Digital 

provide a signal which is routed to a television for display video Distribution Network in accordance with the present 
of the mam program and the commercial, in turn. A number invention. The distribution network includes Video Infer- 
L of null packets arc provided between a pre-splicing packet malion providers (viPs) shown generally at 100, a gateway, 
of the mam program and a first packet of the commercial to 15 shown genera iiy at 120, an access network, shown generally 
prevent overflow of the buffer. In particular, the number L is at 140> and lhe home of a video Information User (VIU), 
determined according to the respective data rates of the main shown gene rally at 160. The gateway 120 may comprise an 
program and the commercial. Additionally, L may be deter- L1 Gateway manufactured by Teleco. The VTPs may include 
mined according to a decoding delay time of the decoder, a ^ei 102, an interactive data server 104, and an 

and according to a padding delay which prevents a decoding 20 inlernet gateway 106> alI of which communicate with an 
discontinuity. The decoder provides a signal for display on asynchronous transfer mode (ATM) network 122 via for 
a display device such that a transition between the main examplC) an oc _ 3 system> where optical fi5er is used to 
program and the commercial, and back again, is substan- transmit data at 155 52 Mbit/sec. The ATM network 122 
tially seamless. ^ may a ^ so rece j ve data via a satellite receiving antenna 110, 

BRIEF DESCRIPTION OF THE DRAWINGS broadcast encoder and server 112, and ATM multiplexer 114. 

The ATM network 122 communicates with a session man- 

FIG. 1 is a block diagram of a Fiber-to-the-Curb Digital a gp r 123. 
Video Distribution Network in accordance with the present ^ ^ network 122 may provide informatioa t0 one or 
invention. ^ more access networks, such as a cable television distribution 

FIG. 2 is a block diagram of a Hybrid Fiber Coax Digital headend 140. First, however, the information from the ATM 
Video Distribution Network in accordance with the present network is processed via a Digital Ad Insertion Module 
invention. (DAIM) 130 in accordance with the present invention. 

FIG. 3 is a block diagram of a Digital Ad Insertion Information, such as a network television program, passes 
Module in accordance with the present invention. 35 between the ATM network 122 and the DAIM 130 via an 

FIG. 4 is a block diagram of an Insertion Processing Unit ATM receiver (Rx) interface (I/F) 124. The DAIM 130 
of a Digital Ad Insertion Module in accordance with the receives the information as a compressed digital packetized 
present invention. . data stream and accesses an inserted stream storage unit 135 . 

FIG. 5 illustrates the processing flow of the Insertion storage unit may include a digitized library of adver- 

Processing Unit of FIG. 4 in accordance with the present 40 hsements (e.g., commercials) which are available to insert 
invention. m to tne network television program. The storage unit 135 

FIGS. 6a to 6c arc diagrammatic illustrations showing ™ a , y J?? ude digital audio tapes (DATs), digital video disks 
how variable length PES packets are reorganized into fixed ( DVDs )> compact audio discs (CDs) or other magnetic or 
length transport packets for use in providing a transport °P tlcal storage media. 

multiplex for transmission. 45 In accordance with the present invention, the DAIM 130 

FIGS. 7a-7d show a pre-splicing data packet having an ioserts a com P ressed digital packetized advertisement 
adaptation field and PES header before and after processing stream mto the compressed digital packetized data stream of 
in accordance with the present invention. the Detwork television program without decompressing the 

FIGS. Sa and Sb show a pre-splicing data packet having JSgSfi .fn £?* ° D - " 
an adaptation field but no PES header before and after 50 F T ? S ^ ^T^^? 

processing in accordance with the present invention. ™* *J "™*2 P rotoco \ ° f w ^. wl ? the embodl ; 

o^c n n , . .. . . _ _ . ment of FIG. 1 is particularly suited for the insertion of 

FIGS. 9a-9d show a pre-splicing data packet having no advertisements into a network television program, there are 
adaptation field but with a PES header before and after maDy olher wfol appUca tions, including^ insertion of 
processing in accordance with the present invention. 55 edu cational programming, emergency messages such as 

FIGS. 10a and 10b show a pre-splicing data packet having weather bulletins, informational messages from the cable 
no adaptation field or PES header before and after process- sys tem operator, and the like. Furthermore, audio only or 
mg in accordance with the present invention. data only messages may be inserted into the main packetized 

FIGS, lla-lld show a post-splicing data packet having data stream. Moreover, the same message may be inserted 
an adaptation field and PES header before and after pro- 60 into more than one main program at the same time, and 
cessing in accordance with the present invention. different messages may be inserted into different main 

FIGS. 12a and 126 show a post-splicing data packet programs at the same time, 
having an adaptation field but no PES header before and A compressed digital packetized data stream which 
after processing in accordance with the present invention. includes the inserted message combined with the main 

FIGS. 13a-13d show a post-splicing data packet having 65 program is output from the DAIM 130 to an ATM trans- 
no adaptation field but with a PES header before and after mitter (Tx) interface 126, and then provided to an access 
processing in accordance with the present invention. network (e.g., cable system headend) 140. In the access 
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network 140, a Host Digital Terminal (HDT) 144 receives is provided to a Main Stream Parser (MSP) 415. The MSP 

the data stream and also receives control signals from an also receives an input labeled T_in, which is the desired 

element manager 142, which manages the cable network. starting time of the insertion of the insertion stream into the 

The HDT 144, which is a specialized digital switch which is mam stream. Similarly, after processing by the packet 

typically located in a head office of the cable system, s framer 410, the insertion stream is provided to an Insertion 

communicates with one or more Optical Node Units stream Parser (ISP) 420. The ISP also receives an input 

(ONUs), including ONU 146. The ONU is located in the la5eled T_out, which is the desired ending time of the 

local curb and supports an optical to electrical conversion of the insertion stream imo me main T _ iQ 

and modulation/demodulation. The ONU 146 then provides bc Q ^ fa the mam strcamj Qr it be ided 

the data stream over a coax distribution network to one or m ^ SU(± M a| tfa£ cab , e m headend SimilarlVj 

more subscriber s homes or offices. At each home a drop T_out may be carried in the main stream, insertion stream, 

box 164 located near the home receives the combined digita or be generated locaUy . 

signal and provides it to a Digital Entertainment Terminal _ . . ' . , , A e . 

(DET) (e.g., decoder) 168 and a Network Interface Module ^ , mam slr ' am P^ r 415 P ar f s *c data packets of the 

NIM 166. The DET decodes the packetized data stream, „ ™ m if™ and Prides signals to a video buffer manager 

and the signal is seamlessly delivered for display to the 15 These signals include a Program Clock Reference 

Video Information User (VIU) (e.g., subscriber) via televi- D ' codm S Time Stam .P <P™>> and a Vlde ° blt rale ' 

sions 170, 172 and/or personal computer 174. R - v ' ^ ^ stream. Simuar y the insertion stream 

~~ „. (1 , ,. - „; T .r... ^ r^. • , parser 420 parses the data packets of the insertion stream to 

"°- 2 . 15 a block diagram of a Hybrid Fiber Coax Digital v p( T R , DTS , ^ £ yl si k to the videQ buflfer 

Video Distrtbution Network in accordance with the present 20 * 425 whcfe me ^ mdicates a am ^ 

invention Like-numbered 'elements correspond to the ele- eter J* ^ inscrtion ^ ^ vkJeo buffcr m ^ 425 

mentsof FIG. 1. The distribution network includes a satellite .,„„ . . . . . , . ■ . , KT r 

.. , . „ „. , ... . uses the input signals to determine a number, N, or null 

uplink, shown generally at 200, a satellite downlink, shown . f , . _ . # . . . \ . . 

„ / i •§ j \ ttt t> i packets which will be mserted into the output data stream, 

generally at 240, an access network 140 and a VIU s home f, „ .• . . „ „ . „ . . «. Za •, „ . 

i £n tv. .11-. I- i • i j u j j In particular, to avoid a decoder buffer overflow, it may be 

160. The saterhte uplink 200 includes a broadcast encoder 25 q £ &dd qu11 s thc ou strcam ^ 

and server 205, which may also perform an encryption iti ' frQm ± ^ ^ fa ^ and du e ring 

function, an MPEG multiplexer 210, a modulator 215, and ^ from in5ertioD main stream tf ^ 

a transmittmg antenna 220. The satellite downlink 240 , , , , . . . . V 

... 6 . . , -~ . . . msertion stream has a higher data rate than the mam stream, 

mcludes a receiving antenna 242, and an integrated receiver Dumber ^ ed cket 

244. The signal received at he antenna 242 typically com- 30 atQr flQd ^ Data P Bu ffer (DB) 485 which is 

prises a multiplex of encrypted channels (e.g., one hundred ^ of aQ buffer 4?5 Tbe QB 485 c ^ om i unicates with 

or more channels) from various programming service pro- a svntax p rooe ssor 470 

viders. The received multiplexed signal is processed at the ZT . * „ , , 

integrated receiver 244 by a demodulator 246 and decryp- ^ main stream parser 415 provides the mam stream data 

tion function 248 *° a mam stream buffer 480, which communicates with a 

Tne recovered multiplex of channels is then provided to * f h yntax f T0 ^°J ™J*™? T ^ 480 15 V Vn 

the DAIM 250 for processing in accordance with the present the b ^J 7S - ™* l ^ rtl ° n «™* parser 420 

invention. The oXlM acceLs an inserted stream storage f™ 1 ^. the ^° n StrCi f A data * *^TT Sp ^ C 

unitiaStoretrieveacompresseddigitalpacketizedmessage Information (PS^rogram den^ 

for ;„„H,- nn ,r,^ ^ . *1 rtf whtch replaces the PSI tables and PIDs of the insertion 

tor insertion into one or more main channels ot the multi- 40 , r. c . ™. , 

plex. After processing by the DAIM, tbe one or more ^^^^^f^^T^i^m 

combined signals are received by a transcoder 260 for 435 retneves lbe rel f Vant ^°^ atl ° n fr ° m f mai " Stre p a " 

encryption and/or modulation at function 265, as well ^ ' ^7°^ P f ls ^ sh °7- ^ e p fl 

known in the art. The multiplex of signals, including the and PID da!a ° f ! he mai ° Stream P r0Vlde l b f 10 

signal with the inserted messages, is then received by the 45 C0D f Qec the vanoUS . aud, °' ^ ™* data P ackets t0 a 

access network 140 and transmitted to the subscribers' PfV^ P^mming service. SpeciflcaUy, t^ is accom- 

homes for display at the VIU's home 160 as discussed in P^ hed ™* I P^™** 

connection with FIG. L Ph «™ f Map Table (PMT). The insertion steam « then 

, . , ,. r tA- • 1 aj 1 provided to an Insertion Stream Buffer (1SB) 490, which is 

uSS" mliL ° f ? lgl f r° n P^ of the out P ut buffcr 475 - T»» ISB 490 communicates 

Module (DAIM) ^ accordance with the present invention, so ^ a s tax 470 . Furthcrmorc> Uje output buffer 

Advantageously, the DAIM 300 is compaUble with existing 4?5 ^ mmands from a buffcr controll £ 465 tQ 

communication networks including [ the FibeMo-Ae-curb yidc aQ ^ ^ ^ ^ ^ strcam 

network of FIG. 1, and the Hybrid Fiber Coax network of fl ccl „ c „,:^j t u„ m - e »„ OTT , 

^ tl n*iw • . ^»*o\ , ■ , lessly spliced into the mam stream. 

FIG. 2. The DAIM receives a mam stream (MS) which , ^ . . 

comprises a primary data stream such as a network televi- 55 Fuither deta ^ ° f ^ JJ™ 115 cments of thc insertlOD 

sion program, and an insertion stream (IS), which comprises Posing 400 of FIG 4 will now be discussed. The 

a secondary data stream such as a commercial message. Allowing terms and variables will be used: 

Within the DAIM, an external control interface 310 com- IPU: Insertion Processing Unit— a unit inside the Digital 

municates with an Insertion Processing Unit (IPU) 400. Ad-Insertion Module. 

After the commercial message is inserted into the main so Mam Strea rn (MS): The incoming digital stream that 

stream, an output stream is produced. carries the normal digital video programming services. 

FIG. 4 is a block diagram of an Insertion Processing Unit Insertion Stream (IS): The digital stream segment that will 

(IPU) of a Digital Ad Insertion Module in accordance with be inserted into the main stream, 

the present invention. The IPU, shown generally at 400, Output Stream (OS): The outgoing main stream after 

receives the main stream at a packet framer 405, while the 65 insertion. 

insertion stream is received at another packet framer 410. T_in: The external signal indicating the desired starting 

After processing by the packet framer 405, the main stream time of the insertion in thc main strcam. 
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T_out: The external signal indicating the desired ending insertion stream into the main stream. Note that the terms 

time of the insertion in the main stream. "insertion stream," "secondary stream," or the like as used 

sp__in: The insertion starting position, or splicing start herein can denote replacement (e.g., overwriting) of packets 

point, in the main stream. It is generated internally by of the main stream as well as insertion without loss of any 

the DAIM, and is not necessarily coincident with T_in. 5 main stream packets. However, this latter case will require 

s P out: The insertion ending position, or splicing end a la, S e ™J"! of memor >' 1 to store ^ P°J? n ° f ^ main 

point, in the main stream. It is generated internally by stream whlch ls ^Porarily suspended while the insertion 

the DAIM, and is not necessarily coincident with stream is transmitted. 

j out If the mam stream carries a plurality of programs, the IPU 

T, ' ..„,.. .10 can insert the packets of the insertion stream into transport 

sp_m : The starting posiUon of the insertion segment in packetJ . fa ^ maifl stream ^ bdong to 0Qe Qr mQK 

the insertion stream. selected programs. In this case, the data rate of each elemen- 

sp_out': The ending position of the insertion segment in t ary str eam in the insertion stream should be tbe same as the 

the insertion stream. data rate of the corresponding programs in the main stream. 
MPEG: Moving Picture Experts Group for video, audio 15 For example, the rate of a video elementary stream in the 

and system coding format. insertion stream should be equal to the rate of the video 

TS: The MPEG Transport Stream which uses the 188 byte elementary main stream which is to receive the insertion 

packet format. data. The IPU processes the packets near the beginning and 

Null Packet: A transport packet that does not contain any end ° f the insertion 80 *» strcam is MPEG 

valid audio/video data. 20 ^P 118111 - 

The main stream packet framer 405 receives a fully 

Number ol nuI1 packets. compliant, unaligned MPEG-2 main transport stream at its 

PID: The Program IDentifier carried in each MPEG channel input. The main stream data is in a serial format. The 

transport packet indicating the presence of a data MPEG-2 transport packet synchronization byte may occur at 

stream. 25 any bit position. The packet framer 405 provides the trans- 

PSI: Program Specific Information carried in the transport port packet alignment, and outputs a transport stream which 

packet indicating the mapping of a group of PIDs to is aligned to the packet boundary. The insertion stream 

individual programs. It includes PAT/PMT. packet framer 410 performs a similar function for the 

PES: Packetized Elementary Stream is a layer of data insertion stream. 

carried by the TS. 30 ^ Main Stream Parser (MSP) 415 and Insertion Stream 

ES: Elementary Stream-^an be video, audio, or data. Pars " < ISP > 420 arc used , to Pf™ 5 me main stream and 

„ , , msertion streams, respectively. The stream parsers parse the 

PCR: Program Clock Reference-system clock time ctivc a%ned strcams of lhc kct framcra ^ and 

stamps which are carried in the mam stream. 41Q frQm |fae transport layer (0 ^ pfctuic layer M a ^ 

PCR': Program Clock References-system clock time 35 prior to T_in, the MSP 415 bypasses the main stream in its 

stamps which are carried in the insertion stream. input and send the stream directly to tbe main stream buffer 

DTS: Decoding Time Stamps indicating the decoding 480, and the ISP 420 parses the input insertion stream to 

time of each ES element in the main stream. locate the sequence start code. When a packet with a 

DTS': Decoding Time Stamps indicating the decoding sequence start code is detected in the insertion stream, the 

time of each ES element in the insertion stream. 40 ISP P uts address of this packet into a register (not 

R_v: Video bit rate for the main stream. shown )- ^ address fa a read address for insertion 

R_v': Video bit rate for the insertion stream. Ac " oc T . . , . . , MCD . 

As soon as 1 in is detected, the MSP parses the mam 

Sequence Header: The highest layer of header in a MPEG slream l0 locate transport packet with the next, or most 

video stream. 45 rccen t previous (if still available), anchor picture start code. 

GOP Header: Group of Pictures header — the second layer When an I or P picture start code is found in the main stream 

of header followed by a complete self-contained transport packets, the MSP 415 sends the transport packet 

sequence of pictures (e.g., frames). which contains the anchor picture start code (e.g., the last 

Picture Header: The header which precedes each picture. packet of the main stream) to the syntax processor 470 for 

I Picture: Intra-coded picture that can be decoded without 50 processing. Also at this time, the ISP 420 sends the first 

referring to another picture. packet of the insertion stream to the syntax processor 470 to 

P Picture: Forward predicted picture that can be decoded "? xcd " or as discussed below in greater 

using the previous decoded I or P picture. detaiL Whea a Vldc ° buffer vcnficr ( c -8-» MPEG parameter 

A . n . , in-. u • „ "vbv_buffer") management is required, tbe MSP 415 and 

Anchor Picture: I or P pictures are anchor pictures since „ TOD rr n ... \ . 6 , \* n ' . . 

. . j * ,55 ISP 420 will also have to parse the PCR, DTS, video rate 

they may be used as a reference to predict another u n , , " p . ' . y rmu " m 

oicture — v or — v ' an 0 parameters as required, store them 

„ „. ' . . , . in the data buffer 485, and provide them to the video buffer 

B Picture: Bi-directionally predicted picture that can be manager 425 

decoded using the previous and next I or P decoded The is a hypothetical decoder which is conceptually 

picture. Cannot be used as an anchor picture. 6Q ntmsOtd to the output of an encoder. Coded data is placed 

vbv_3uffer: Virtual Buffer Verifier (VBV)— a conceptual m the buffer at the constant bit rate that is being used, and 

decoder channel buffer that shall not overflow or under- is removed according to which data has been in the buffer for 

A° w - the longest period of time. Tbe bitstream produced by an 

R_t: Transport stream data rate. encoder or editor must not cause the VBV to either overflow 

The IPU 400 can process a main transport stream that 65 or underflow. The MSB 415 and ISB 420 output the same 

includes one or more programs (e.g., channels). If the main transport slream which appeared at the input after parsing as 

strcam carries only a single program, the IPU inserts the discussed. 
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At the time T„out, the operation of the MSP and ISP is 
similar to the T_in point, except that the main stream and 
insertion stream are interchanged. That is, after the insertion 
stream has been inserted into the main stream, the main 
stream must be coupled with the end of the insertion stream. 
To accomplish this, as soon as T_out is detected, the ISP 
will parse the insertion stream to locate the transport packet 
with the next, or most recent previous (if still available), 
anchor picture start code. When an I or P picture start code . . 

is found in the insertion stream transport packets, the ISP id 6111011011 of mc rc S lstcr locaUon - 



the number of null packets. A map of registers which may be 
used in accordance with the present invention is given in 
Table 1, below. It should be appreciated that Table 1 is an 
example only, and any other suitable map could be used. In 
Table 1, the first column indicates the register index, the 
second column indicates the number of bits, the third 
column indicates whether read (R) and/or write (W) capa- 
bility is required, and the fourth column describes the 



420 sends the transport packet which contains the anchor 
picture start code (e.g., the last packet of the insertion 
stream) to the syntax processor 470 for processing. Also at 
this time, the MSP 415 sends the first packet of the remain- 
der of the main stream to the syntax processor 470 for 15 
processing. In this manner, the transition from the end of the 
insertion stream to the beginning of the remainder of the 
main stream can be performed seamlessly. 

The video buffer manager 425 checks for the fullness of 
the video buffer according to its inputs, PCR, PCR', DTS, 20 
DTS 1 , and video data rates R_v and R_v\ In case of a 
potential buffer overflow, it instructs the null packet genera- 
tor 430 to generate Lnull packets and insert the packets into 
the output stream. The number of packets to generate is 
stored in a register. 25 
' The syntax processor 470, which can communicate with 
the MSB 480, DB 485 and ISB 490 of the output buffer 475, 
processes the last packet before the splicing point and the 
first packet after the splicing point to provide a seamless 
transition that is MPEG compliant. At T_in, the syntax 3D 
processor 470 reads the last transport packet from the main 
stream and the first packet from the insertion stream. It 
checks the syntax of the packets and repairs them, if 
necessary, so that they will be MPEG compliant, as will be 
discussed below in greater detail. At T_out, the syntax 35 
processor 470 operates in the similar way except that the 
main stream and insertion stream are interchanged. That is, 
the syntax processor 470 will read the last transport packet 
from the insertion stream and the first packet from the main 
stream, and then check the syntax of the packets and repair 40 
them, if necessary. Thus, the syntax processor 470 receives 
unfixed packets and addresses for the unfixed packets, and 
outputs fixed packets. 

In the event of potential buffer overflow, the null packet 
generator 430 is instructed by the video buffer manager to 45 
generate null packets and insert them to the output. Thus, the 
null packet generator 430 receives a signal to generate null 
packets, and the number L of packets to generate, and 
outputs null packets. 

It is desired that the PIDs of the resulting output stream do 50 
not change after the insertion. Accordingly, a PSI/PID 
replacer 435 is provided to replace the PSI tables and PIDs 
of the inserted stream with those of the main stream. The 
PSI/PID replacer 435 receives transport packets with the old 
PSI/PID, new PSI tables, and a PID conversion table, and 55 
outputs transport packets with the PSI/PID replaced. 

The output buffer 475 is divided into three parts. The Data 
Buffer (DB) 485 is used to store common data such as PSI 
and null packets. The Main Stream Buffer (MSB) 480 and 
Insertion Stream Buffer (ISB) 490 are used to store the main 60 
siream and insertion stream, respectively. 

A buffer controller 465 is used to coordinate the read and 
write operations of the DB, MSB, and ISB. It also performs 
addressing and output scheduling of each transport packet 
stored in the MSB, ISB and DB. 65 

A group of registers (not shown) is used in the system for 
storing various parameters such as packet addresses and N, 



TABLE 1 



Index 


Bits 


R/W Description 


1 


7:0 


R.W Read address for main stream 


2 


7:0 


R,W Read address for main stream 


3 


7.-0 


R,W Read address for main stream 


4 


70 


R,W Read address for main stream 


5 


7.-0 


R,W Write address for main stream 


6 


7:0 


R,W Write address for main stream 


7 


7:0 


R,W Write address for main stream 


8 


7:0 


R.W Write address for main stream 


9 


7:0 


R,W Read address for insertion stream 


10 


7:0 


R,W Read address for insertion stream 


11 


7:0 


R,W Read address for insertion stream 


12 


7:0 


R,W Read address for insertion stream 


13 


70 


R,W Write address for insertion stream 


14 


7:0 


R.W Write address for insertion stream 


15 


7:0 


R.W Write address for insertion stream 


16 


7:0 


R,W Write address for insertion stream 


17 


7:0 


R.W PCR of current stream 


18 


7:0 


R.W PCR of current stream 


19 


7:0 


R.W PCR of current stream 


20 


7:0 


R.W PCR of current stream 


21 


70 


R,W PCR of current stream 


22 


7.0 


R.W PCR of current stream 


23 


70 


R.W DTS of current stream 


24 


70 


R,W DTS of current stream 


25 


70 


R.W DTS of current stream 


26 


70 


R.W DTS of current stream 


27 


70 


R,W DTS of current stream 


28 


70 


R.W Address for PAT 


29 


70 


R.W Address for PAT 


30 


70 


R.W Address for PAT 


31 


70 


R.W Address for PAT 


32 


70 


R,W Size of PAT in number of packets 


33 


70 


R,W Address for PMT 


34 


70 


R/W Address for PMT 


35 


70 


R.W Address for PMT 


36 


70 


R.W Address for PMT 


37 


7:0 


R.W Size of PMT in number of packets 


38 




Interrupt register. 




7 


R SS, Splicing signal. 1 : SS is detected; 0: splicing 
processing done 




6 


R MSD, 1: Main stream done 




5 


R ISD, 1: Insertion stream done 




4 


R NPD, 1: Null packets done 




3 


R APF, 1: Anchor picture found 




20 


N/A Reserved 


39 


70 


R,W Number of Null packets to generate 


40 


70 


R,W Stream output read address 


41 


70 


R.W Stream output read address 


42 


70 


R.W Stream output read address 


43 


70 


R.W Stream output read address 


44 


70 


R.W Main video elementary stream rate 


45 


70 


R,W Main video elementary stream rate 


46 


70 


R.W Main video elementary stream rate 


47 


7:0 


R.W Insertion video elementary stream rate 


48 


70 


R.W Insertion video elementary stream rate 


49 


70 


R.W Insertion video elementary stream rate 


50 


70 


R,W PID1 of main stream 


51 


7:3 


R.W PiDl of mainstream 


51 


70 


R,W PID2 of main stream 


52 


7-3 


R,W PID2 of main stream 


53 


70 


R.W PID3 of main stream 


54 


7-3 


R,W PID3 of main stream 


55 


70 


R,W PID4 of main stream 


56 


7-3 


R.W PID4 of main stream 


57 


70 


R,W PfDl of insertion stream 
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TABLE 1 -continued 



Index 


Bits 


R/W Description 


58 


7:3 


R,W PID1 of insertion stream 


59 


7:0 


R,W PID2 of insertion stream 


60 


7:3 


R,W PID2 of insertion stream 


61 


7:0 


R,W PID3 of insertion scream 


62 


7:3 


R,W PID3 of insertion stream 


63 


7:0 


R,W PID4 of insertion stream 


64 


7:3 


R,W PID4 of insertion stream 


65-68 


7:0 


R,W Read address for PID1 of insertion stream 


69-72 


7:0 


R,W Write address for PD31 of insertion stream 


73-76 


7:0 


R,W Read address for VID2 of insertion stream 


77-80 


7:0 


R,W Write address for PID2 of insertion stream 


81-84 


7:0 


R,W Read address for PID3 of insertion stream 


85-88 


7:0 


R,W Write address for PID3 of insertion stream 


89-92 


7:0 


R,W Read address for PID4 of insertion stream 


93-96 


7:0 


R,W Write address for PID4 of insertion stream 



The complexity of the IPU largely depends on the video 
buffer management scheme. Two implementations of a 
video buffer management scheme in accordance with the 
present invention are presented. First, in a simplified 
version, the number Lof null packets for padding the output 
stream to prevent buffer overflow are provided only accord- 
ing to the video elementary stream data rates of the main and 
insertion stream, R_v and R_v', respectively. At T_in, the 
number of packets to pad with null data is computed as: 

L=vbv_buffer_size * (1/R_v-1/R_v') * R_t/(188*8). 
At T_out, the number of packets to pad is computed as: 

L=vbv_buffer_size * (1/R_v'-1/R_v) * R_t/(188*8). 
The advantage of this scheme is a simplified 
implementation, and there is no need to track the PCR and 
DTS of the stream. The disadvantages are that padding is 
larger than needed, and decoding or display discontinuities 
may result. Note that padding is required only when the 
insertion stream has a higher data rate than the main stream. 

In a second, more complete version of the video buffer 
management scheme, padding is used according to a decod- 
ing delay of the main and insertion stream and the video 
elementary stream rates. The decoding delay is the differ- 
ence between the time the first byte of a picture is received 
and the time when decoding is completed. With this scheme, 
at T_in, the number of packets to pad is computed as: 

L-(decoding_delay-vbv_buffer_jsize/R_v') * R_t7 
(188*8). 

At T_out, the number of packets to pad is computed as: 
L-(decoding_delay-vbv_buffer_size/R_v) * R_t/ 
(188*8). 

The advantages of this second embodiment are that pad- 
ding is used only as needed, and there is no chance of a 
decoding or display discontinuity caused by padding. A 
disadvantage is that the decoding delay must be computed, 
and therefore the PCR and DTS of the data stream must be 
retrieved and decoded. This requires additional hardware 
and expense. 

With either of the above schemes, the calculation of the 
number of null padding packets can be computed using the 
following definitions and assumptions. 
Definitions: 

B0: Video decoding buffer size at the end of old stream. 
vbv_buffer size: 1.75 Mb or 1835008 bit 
T_pad: Duration of null padding bits. 
At T_in point: 
B0-R_v * T_pad+(R-V'-R_v)*(decoding_delay-T_ 

pad) =vbv__buffcr_sizc; and 
T_pad^decoding_delay* (1 -R_v/R_v , )-(vbv_ 

buffer_size-B0)/R_v\ 
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Since B0»decoding__delay*R_v, we have: 

T_pad ^ decoding_delay-vbv__buffe r_size/R_v*. 
Since decoding_delay<vbv_buffer/R_v, to simplify the 
computation, T_pad can be written as: 
5 T_padivbv__buffer_size* (1/R_v-1/R_v'). 

For example, if R_v-4 Mbps and R_v'-8 Mbps, then the 
padding time will be: 
T_pad-1835008 * (%-V»)-0.23 sec. 
1Q However, this does not mean that the viewer will detect a 
discontinuity of 0.23 second. In fact, there will be no visible 
discontinuity when the data is displayed on a television 
screen since the 0.23 second delay only flushes out part of 
the data in the video decoding buffer. After 0.23 second, the 
15 data from the insertion stream will fill the buffer while the 
decoder is still decoding the data from the main stream. As 
long as the time to decode the remaining data in the video 
decoding buffer is greater or equal to (vbv_delay_of_ 
first_picture — l/picture_rate) of the insertion stream, there 
2Q will be no decoding discontinuity. 

Furthermore, at T_out, T_pad is computed as: 
T_pad ^ decoding_deIay-vb v_buffer_size/R_v, or 

simplified to: 
T_pad^vbv_buffer_size* (1/R_v'-1/R_v) 
25 The number of padding packets, N, can therefore be 
computed as: 
L-T_pad * R_t/(188*8). 

FIG. 5 illustrates the processing flow of the Insertion 
Processing Unit of FIG. 4 in accordance with the present 

30 invention. Note that the steps of FIG. 5 are shown as 
occurring in a sequential manner for clarity, but many of the 
steps may occur concurrently and/or sequentially. At block 
502, the IPU outputs the main transport stream from the 
main stream buffer (MSB) 480. The IPU is essentially in a 

35 bypass mode at this time since the insertion stream has not 
yet been inserted. At block 506, the main stream parser 
parses the main stream to locate the splicing signal T_in. 
Note that T_in need not be carried in the main stream, but 
may be provided locally, for example, at a cable system 

40 headend. When T_in is detected, the IPU continues to 
output the main transport stream from the main stream 
buffer. At block 508, the main stream parser parses the main 
stream to locate the closest packet with an anchor picture 
(e.g., I or P picture) start code and passes that packet to the 

45 syntax processor 470. This packet will be the last packet of 
the main stream. To ensure that the resulting data stream is 
MPEG compliant, no data from the next frame or sequence 
of frames may be included in this last main stream packet. 
At block 512, the syntax processor adds a sequence end code 

50 field to the last packet of the main stream. The sequence end 
code is a twenty-four bit code which indicates the end of a 
sequence of pictures. At block 514, the PSI/PID replacer 435 
starts to replace the PSI/PID of the insertion stream. 
At block 516, the syntax processor processes the first 

55 packet of the insertion stream (e.g., the packet which con- 
tains the sequence start code) so that any data before the 
sequence start code in this packet that is coming from the 
insertion stream is replaced with stuffing bytes in the adap- 
tation field. If the adaptation field does not exist, it is created. 

60 The packet's transport header and PES header are also 
modified to ensure that the output stream is MPEG compli- 
ant. The syntax processor also sets the discontinuity indica- 
tors of the insertion stream in ISB for all the packets before 
the PCR packet to "1". 

65 At block 518, the video buffer manager 425 calculates the 
number, N, of null packets to pad. At block 520, at the end 
of the main stream, which is designated as the position 
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sp in, an interrupt signal, Main Stream Done (MSD), is 

generated. At block 522, after receiving the MSD signal, the 
IPU reads the null packets from the data buffer 435 and 
writes the null packets to the output stream. At block 524, at 
the end of the null packets, an interrupt signal, Null Packets 
Done (NPD), is generated. 

At block 526, after receiving the NPD signal, the system 
begins to output data from the insertion stream buffer 490 at 
a position which is designated sp_in'. At the same time, the 
MSP reads from the main stream and puts a new sequence 
in the MSB. 

At block 530, when T_out is detected, the processing 
continues at block 540. Otherwise, the system is in a waiting 
mode until T_out is received. At this time, the system 
continues to output data from the ISB. Generally, T_out 
may be provided locally, for example, by a cable system 
headend. However, it may be preferable for T_jn andT_out 
to be provided in the main stream so that the cable headend 
is not tasked with managing the time and duration of the 
insertion. Moreover, the gap in the main stream in which the 
insertion stream is to be provided will not typically be 
controllable by the cable headend. At block 540, the ISP 
parses the insertion stream for the packet with an anchor 
picture start code and passes that packet to the syntax 
processor. This will be the last packet of the insertion stream. 
The syntax processor processes this last packet of the 
insertion stream so that there is no data from the next frame 
or sequence of frames included in the packet. Thus, the 
resulting data stream will be MPEG compliant. At block 
544, the syntax processor adds a sequence end code field to 
the last packet of the insertion stream. 

At block 546, the syntax processor processes the first 
packet of the main stream (which contains the sequence start 
code) so that any data before the sequence start code in this 
packet that is coming from main stream is replaced with 
zeros. The packet's transport header and PES header are also 
modified to ensure that the output stream is MPEG compli- 
ant. The syntax processor also sets the discontinuity indica- 
tors of the main stream in the MSB for all the packets before 
the PCR packet to "1". 

At block 548, the video buffer manager calculates the 
number of null packets to pad. At block 550, at the end of 
IS, which is designated sp_out', an interrupt signal, Inser- 
tion Stream Done (ISD), is generated. At block 552, after 
receiving the ISD signal, the system reads the null packets 
from the data buffer and writes to the output stream. At block 
554, at the end of the null packets, an interrupt signal, Null 
Packets Done (NPD), is generated. At block 556, after 
receiving the NPD signal, the system begins to read from the 
MSB at a point which is designated sp_out. Thus, at this 
time, the insertion stream ends and the next portion of the 
main stream begins to be output. At the same time, the ISP 
reads from the insertion stream and puts a new sequence in 
the ISB for future use. The process continues at block 506, 
where the MSP parses the main stream for the next splicing 
signal, T_in. 

In practice, the invention is particularly suitable for insert- 
ing commercial messages into one or more network televi- 
sion programs. For example, often times a network program 
is transmitted via satellite to local cable system operators. 
The cable system operator has the task of inserting com- 
mercials from local businesses into the main stream. In this 
case, it may be desirable to provide commercials, for 
example, every twenty minutes. Furthermore, assume one 
commercial is inserted, and that the commercial has a 
duration of one minute. Then, for a network program which 
runs from 8:00 p.m. to 9:00 p.m., we may have T_in=8:00 
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p.m., T_out-8:01 p.m., then T_in-8:20 p.m., T_out-8:21 
p.m., and finally T_in-8:59 p.m., T_out-9:00 p.m. Other 
variations are possible, of course. For example, a prere- 
corded series of commercials may be assembled. In this 
S case, the beginning of the first commercial will correspond 
to T_in, and the end of the last commercial may correspond 
to T_out. Alternatively, the network program may include 
one or more commercials already in the main transport 
stream. In this case, the present invention may be used to 
to replace selected ones of the main stream commercials, or to 
remove selected ones of the commercials without replace- 
ment. Note that the latter case may not be possible in 
real-time. 

In order to implement the processing flow of FIG. 5, the 

is structure of a packetized data stream must be examined in 
greater detail. In a packetized digital data stream, typically 
the packets carrying the compressed video data will be 
multiplexed with other packets, e.g., carrying corresponding 
audio data and control information necessary to reconstruct 

20 a television signal. One standard for transporting digital 
television signals in this manner is the MPEG-2 standard, 
details of which can found in document AVC-491, version 1, 
April, 1993, published by the Telecommunications Stan- 
dardization Sector, Study Group 15, Experts Group 4ATM- 

25 Video Coding of the International Organization for 
Standardization, ISO-IEC/JTC1/SC29/WG11 entitled 
"Coded Representation of Picture and Audio Information," 
incorporated herein by reference; ISO/TEC 13818-2, Mar. 
25, 1994, entitled "Generic Coding of Moving Pictures and 

30 Associated Audio," incorporated herein by reference; and 
ISO/IEC 13818-1, Apr. 27, 1995, entitled "Coding of Audio, 
Picture, Multimedia and Hypermedia Information," incor- 
porated herein by reference. Further details of the video 
syntax and semantics for MPEG-2 video can be found in 

35 International Organization for Standardization document 
ISO/IEC 11172-6 dated Apr. 2, 1993 and entitled "Revised 
Syntax and Semantics for MPEG-2 Video," also incorpo- 
rated herein by reference. Also of interest, and incorporated 
herein by reference, is document MC68VDP/D, a prelimi- 

40 nary data sheet entitled "MPEG-2T>CII Video Decompres- 
sion Processor," ©Motorola Microprocessor and Memory 
Technologies Group, 1994 which describes a video decom- 
pression processor using the MPEG-2 and DigiCipher®II 
standards. 

45 In the MPEG-2 system (and the similar DigiCipher® II 
system proprietary to General Instrument Corporation, the 
assignee hereof) a transport stream, or transport multiplex is 
made up of a contiguous set of fixed length packets. Each 
packet is 188 total bytes in length, with the first four of those 

50 bytes being defined as the packet header. The payload 
portion of each packet is thus normally 184 bytes. However, 
a variable length adaptation field may be provided to extend 
the header, when required. When an adaptation field is 
present, the payload portion of the packet will be corre- 

55 spondingly shorter. 

Various timing and identification information is provided 
in different portions of the transport stream. These include a 
packet identifier (PID) found in the transport header of each 
transport packet to provide a reference number for identi- 

60 fying the transport packets carrying a specific service com- 
ponent. This number is included in a service definition or 
"service map" used by the receiver to identify those trans- 
port packets required to reconstruct a television program 
signal. The PID may also be referenced for various groom- 

65 ing and remultiplexing functions. In the case of video, audio 
or isochronous control data, the stream of packets labeled 
with a single PID represents a single video, audio or 
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isochronous data service elementary stream, respectively. evaluating whether timing and buffer control are operating 

Each type of packet will have a different PID identifying the properly at the decoder. 

packet type. The DTS is a field indicating what value corresponding 

Timing information carried by the transport stream bits of the decoder system time clock reference should have 

includes a program clock reference (PCR) which effectively 5 when the decoder starts to decode the first access unit that 

represents a sample of the system time clock (STC) time starts somewhere in the payload of this PES packet. The PTS 

base that underlies the service composed of the PIDs refer- and DTS differ only for video, and only in the case of the 

eoced in the service map. The PID carrying the packet with 1-frame and the P-frames transmitted with B-frames. 

the PCR is also referenced in the service map. The video, The PES payload contains the information data that is 

audio and isochronous data components of a service are 10 desired to be transmitted to a receiver. Thus, the payload 

locked through a defined relationship to the system time includes all of the video, audio and control information 

clock. The PCR serves to define the transport rate, in the necessary for the receiver to decode and reconstruct, e.g., a 

sense that between any two successive PCRs in one PID, the digital television signal. 

transport rate is constant and nominally equal to the system In order to meet the requirements of robustness and 

time clock rate times the ratio of the total number of 15 simplicity, a fixed packet length approach is preferred to the 

transport bytes between the PCRs divided by the difference variable length PES packets. Thus, as illustrated in FIG. 6b, 

in the PCRs in units of system time clock ticks. the packet elementary stream containing the PES packets 

The timing information carried by the transport stream 670 is reconfigured into a stream of fixed length transport 

also includes time stamps for the commencement of decod- packets 680. The transport packets illustrated in FIG. 6b all 

ing and presentation of data for display. The presentation 20 correspond to the same service component, such as the video 

time stamp (PTS) is used for service component acquisition component of a digital television transmission. In the 

and also for evaluating whether timing and buffer control are MPEG-2 and DigiCipher® II embodiments, each packet is 

operating properly at the decoder. The decoder time stamp 188 total bytes in length, with the first four bytes comprising 

(DTS) is used to indicate when the decoder should start to a transport packet header (TP HDR) 682. The payload 

decode the first access unit (e.g., video frame) that starts in 25 portion 684 of each packet 680 is thus normally 184 bytes, 

the pay load of a packetized elementary stream (PES) packet However, an adaptation field mechanism is present, as 

whose header includes the DTS. A packetized elementary illustrated by transport packet 680', to extend the header 

stream is a data stream composed of end-lo-end PES packets when required. The adaptation field 686 provides additional 

which have variable length and are typically far longer than information which is not required for every transport packet, 

a fixed length transport packet. Thus, a PES packet is 30 The adaptation field (ADPT FIELD) 686 extends the regular 

typically composed of data from a plurality of transport transport header 682 at the expense of payload 684, which 

packets. will be less than 184 bytes whenever the adaptation is 

FIGS. 6a to 6c are diagrammatic illustrations showing provided. The adaptation field 686 is of variable length, 

how variable length PES packets are reorganized into fixed depending on the information it contains. Typically, the 

length transport packets for use in providing a transport 35 adaptation field will support additional information for time 

multiplex for transmission. FIG. 6a illustrates a portion of a base recovery and other functions, and also provides a 

packetized elementary stream carrying successive PES mechanism for padding the payload when it does not occupy 

packets, each having a header (PES-HDR) 672 and a PES the full 184 bytes. Such padding can be used, for example, 

payload 674. The PES packets 670 are of variable length. to make a variable rate video packetized elementary stream 

PES packets are typically several thousand bytes in length. 40 into a constant rate transport stream. 

They are required to be aligned in such a manner that, when As indicated in FIG. 6b, the transport header of each 

divided into transport packet payloads, the first byte of every transport packet includes the PID which identifies the par- 

PES header is located in the first payload position of some ticular service component carried by the transport packet, 

transport packet. For any transport packet carrying the The PCR will be carried by an adaptation field to provide 

aligned PES header, a "payload unit start indicator" will be 45 timing information for a desired service. At a receiver, the 

set in the transport header for the transport packet. In the PCR for the desired service is detected from the adaptation 

MPEG-2 and DigiCiphero® II systems, the PES format is field. The PIDs of the transport packets will then be moni- 

used for all service components that are inherently synchro- tored in accordance with the timing established by the PCR 

nous. More particularly, video, audio and isochronous data to recover those transport packets carrying a particular 

components are carried as packetized elementary streams, 50 component of the service to be processed, 

and the PES headers 672 will carry various information Transport packets from various service components arc 

necessary to define the payload, including a packet start code multiplexed into a transport multiplex 690 as illustrated in 

prefix, a stream identification, and a PES packet length. FIG. 6c. The transport multiplex will carry interspersed 

The header may also contain a presentation time stamp packets from each of the different components (e.g., video, 

(PTS) or decode time stamp (DTS). The PTS is a field which 55 audio and control) necessary to reconstruct a service at the 

indicates the value that corresponding bytes of the decoder receiver. In the illustrative transport multiplex shown in FIG. 

system time clock reference should have when the first 6c, video transport packets 680 (Aj.A^Ag ...) are followed 

presentation unit (i.e., video frame, audio sync frame, iso- by audio components 692 (B lt B 2 , B 3 . . . ) which, in turn, 

chronous data access unit) whose access unit starts some- are followed by control component packets 694 (C„ C^, 

where in the payload of this PES packet is presented. For 60 C 3 . . . ). 

video, an access unit starts if the first byte of the picture start With the foregoing in mind, the operation of the syntax 

code is present in the payload of the PES packet. For audio, processor 470 of the IPU 400 in fixing the packets of the 

an access unit starts if the first byte of the sync word is main stream or the insertion can now be discussed. First, the 

present in the payload of this PES packet. For isochronous process of blocks 508 and 540 will be discussed, wherein the 

data, an access unit starts if the first byte of the data header 65 last packet of the main or insertion stream, respectively, 

is present in the payload of this PES packet. The PTS field before the splicing point, is processed to maintain compli- 

is used for service component acquisition, and also for ance with an MPEG or similar communication protocol. The 
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splicing point is the boundary between the main and inser- 
tion stream packets. This corresponds to the point between 
sp in of the main stream and sp_in' of the insertion stream 
when the output stream transitions from the main to the 
insertion stream, or to the point between sp_out' of the 
insertion stream and sp_put of the main stream when the 
output stream transitions from the insertion to the main 
stream. 

Generally, the last packet of the data stream before the 
splicing point has to be processed since the transport packet 
boundary may not be the same as the picture boundary. This 
last packet will be referred to as a pre -splicing data packet. 
In this case, the pre-splicing packet will contain part of the 
data from the next (anchor) frame. The pre-splicing packet 
can be fixed by discarding the data from the next frame and 
stuffing the same amount of bytes to the adaptation field of 
the last packet, where it is understood that stuffing bytes are 
simply dummy bytes of data. If an adaptation field does not 
exist in the last packet, it can be created. Note that after 
fixing the information contained in the adaptation_field and 
pes_hdr, including adaptation_field_length, payload_ 
unit_start_indicator, pes__length, and other parameters, 
may be changed. However, this is not expected to result in 
any visible discontinuity or artifacts to the viewer when the 
data is displayed. 

Processing of the pre-splicing packet is treated differently 
depending on whether the packet has an adaptation field and 
a PES header, and further depending on the location of data 
fields in the packet. FIGS. la-Id show a pre-splicing data 
packet having an adaptation field and PES header before and 
after processing in accordance with the present invention. 

In FIG. 7a, the packet, shown generally before processing 
at 700, includes a transport header 701, an adaptation field 
702 carrying K bytes, a first data field 703, a PES header 
(pes_hdr) 704, a second data field 705, a picture start code 
706 carrying four bytes, and a third data field 707 carrying 
M bytes. In this case, it can be seen that there is data carried 
in the packet 700 between the adaptation_field 702 and the 
pes_hdr 704, and between the pes_Jidr 704 and the pic_ 
start_code 706. 

Moreover, since the pic_start_code 706 defines the start 
of a new picture or frame, it can be seen that the third data 
field 707 carries data of the new frame. Thus, in accordance 
with the present invention, the packet 700 is processed by 
discarding the data of the pic_start_code 706 and the 
associated third data field 707, and stuffing 4+M dummy 
bytes in the adaptation field 702. This results in the pro- 
cessed packet 710 which includes the adaptation field 712, 
and which terminates with the second data field 705. The 
packet 710 includes data from only one picture and does not 
require the next adjacent packet to maintain continuity. 

Note that in FIGS. 7-11, the relative width of a packet or 
a field thereof does not necessarily indicate the amount of 
data carried in the field or the packet. 

In FIG. lb, the unprocessed packet is shown generally at 
720, and the processed packet is shown generally at 730. 
Here, there is data between the adaptation_field 702 and the 
pes_hdr 704, but not between the pes_hdr 704 and the 
pic_start_code 706. In accordance with the present 
invention, the packet 720 is processed by discarding the data 
of the pes_hdr 704, pic_start_code 706 and the third data 
field 707, and stuffing N+4+M dummy bytes in the adapta- 
tion field 702. This results in the processed packet 730 which 
includes the adaptation field 732, and which terminates with 
the first data field 703. 

In FIG. 7c, the unprocessed packet is shown generally at 
740, and the processed packet is shown generally at 750. 
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Here, there is data between the pes_hdr 704 and the 
pic_start_code 706, but not between the adaptation_field 
702 and the pes__hdr 704. In accordance with the present 
invention, the packet 740 is processed by discarding the data 
5 of the pic_start_code 706 and the third data field 707, and 
stuffing 4+M dummy bytes in the adaptation field 702. This 
results in the processed packet 750 which includes the 
adaptation field 752, and which terminates with the second 
data field 705. 

jo In FIG. 7d, the unprocessed packet is shown generally at 
760. Here, there is no data field between the pes_hdr 704 
and the pic_start_code 706, or between the adaptation_ 
field 702 and the pes_hdr 704. In accordance with the 
present invention, as shown at 770, the entire packet 760 is 

is not transmitted since there would be no data fields remaining 
after discarding the third data field 707. 

FIGS. 8a and 8b show a pre-splicing data packet having 
an adaptation field but no PES header before and after 
processing in accordance with the present invention. In FIG. 

20 8a, the unprocessed packet is shown generally at 800, and 
the processed packet is shown generally at 810. Here, there 
is data between the adaptation field 802 and the pic_start_ 
code 804. In accordance with the present invention, the 
packet 800 is processed by discarding the data of the 

25 pic_start_code 804 and the second data field 805, and 
stuffing 4+M dummy bytes in the adaptation field 802. This 
results in the processed packet 810 which includes the 
adaptation field 812, and which terminates with the first data 
field 803. 

30 In FIG. 8b, the unprocessed packet is shown generally at 
820. Here, there is no data field between the adaptation field 
802 and the pic__start_code 804. In accordance with the 
present invention, as shown at 830, the entire packet 820 is 
not transmitted since there would be no data fields remaining 

35 after discarding the second data field 805. 

FIGS. 9a-9d show a pre-splicing data packet having no 
adaptation field but with a PES header before and after 
processing in accordance with the present invention. In this 
case, an adaptation field is created which carries the dummy 

40 stuffing bits which account for the discarded fields. In FIG. 
9a, the packet, shown generally before processing at 900, 
includes a transport header 901, a first data field 902, a PES 
header 903, a second data field 904, a picture start code 905 
carrying four bytes and a third data field 906 carrying M 

45 bytes. In this case, data is carried between the tp_hdr 901 
and the pes_hdr 903, and between the pes_hdr 903 and the 
pic_start_code 905. In accordance with the present inven- 
tion the packet 900 is processed by discarding the data of the 
pic_start_code 905 and the third data field 906, and ere at - 

50 ing an adaptation field 912 with 4+M dummy bytes as shown 
in the processed packet 910. 

In FIG. 9b, the unprocessed packet is shown generally at 
920, and the processed packet is shown generally at 930. 
Here, there is data between the tp_hdr 901 and the pes_hdr 

55 903, but not between the pes_hdr 903 and the pic_start_ 
code 905. In accordance with the present invention, the 
packet 920 is processed by discarding the data of the 
pes_hdr 903, pic_start_code 905, and the third data field 
906, and creating an adaptation field 932 with N+4+M 

60 dummy bytes, as shown in the processed packet 930. 

In FIG. 9c, the unprocessed packet is shown generally at 
940, and the processed packet is shown generally at 950. 
Here, there is data between the pes_bdr 903 and the 
pic_start_code 905, but not between the tp_Jidr 901 and 

65 the pes_hdr 903. In accordance with the present invention, 
the packet 940 is processed by discarding the data of the 
pic_start_code 905 and the third data field 906, and creat- 
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ing an adaptation field 952 with 4+M dummy bytes, as 
shown in the processed packet 950. 

In FIG. 9d, the unprocessed packet is shown generally at 
960. Here, there is no data field between the tp_hdr 901 and 
the pes_bdr 903, or between the pes_hdr 903 and the 
pic_start_code 905. In accordance with the present 
invention, as shown at 970, the entire packet 960 is not 
transmitted since there would be no data fields remaining 
after discarding the third data field 906. 

FIGS. 10a and 10b show a pre-splicing data packet having 
no adaptation field or PES header before and after process- 
ing in accordance with the present invention. In this case, an 
adaptation field is created which carries the dummy stuffing 
bits which account for the discarded fields. In FIG. 10a, the 
unprocessed packet is shown generally at 1000, and the 
processed packet is shown generally at 1010. Here, there is 
data between the tp_hdr 1001 and the pic_start_code 
1003. In accordance with the present invention, the packet 
1000 is processed by discarding the data of the pic_start_ 
code 1003 and the second data field 1004, and creating an 
adaptation field 1012 with 4+M dummy bytes, as shown in 
the processed packet 1010. 

In FIG. 10£>, the unprocessed packet is shown generally at 
1020. Here, there is no data field between the tp_hdr 1001 
and the pic_start_code 1003. In accordance with the 
present invention, as shown at 1030, the entire packet 1020 
is not transmitted since there would be no data fields 
remaining after discarding the second data field 1004. 

Now, the process of blocks 516 and 546 will be discussed, 
wherein the first packet of the main stream after the second 
splicing point (e.g., sp_out), is processed to maintain com- 
pliance with the MPEG or similar communication protocol. 
This first packet will be referred to as a post-splicing data 
packet. As with the pre-splicing packet, processing of the 
post-splicing packet is treated differently depending on 
whether the packet has an adaptation field and a PES header, 
and further depending on the location of data fields in the 
packet. In particular, the first post-splicing packet must be 
processed by the syntax processor 470 when the splicing 
point does not correspond exactly to a picture boundary. In 
this case, the post-splicing packet may contain part of the 
data from a previous picture or sequence of pictures. 

In accordance with the present invention, the post- 
splicing packet is fixed by discarding the data from the 
previous sequence and stuffing a compensating number of 
dummy bytes to the adaptation field of the post-splicing 
packet. Furthermore, an adaptation field is created if it does 
not already exist. Moreover, as with the processing of the 
pre-splicing packet, the information contained in the 

adaptation field and pcs_hdr, including adaptation_field_ 

length, payload_unit_start_indicator, pes_length, and 
other parameters, may be changed, but this is no expected to 
result in any visible discontinuity or artifacts to the viewer 
when the data is displayed. 

FIGS, lla-lld show a post-splicing data packet having 
an adaptation field and PES header before and after pro- 
cessing in accordance with the present invention. In FIG. 
11a, the packet, shown generally before processing at 1100, 
includes a transport header 1101, an adaptation field 1102 
carrying K bytes, a first data field 1103 carrying N bytes, a 
PES header, pes_hdr 1104, a second data field 1105 carrying 
M bytes, a sequence start code 1106 and a third data field 
1107. In this case, it can be seen that there is data carried 
between the adaptation_fie!d 1102 and the pes_hdr 1104, 
and between the pes__hdr 1104 and the seq_jstart_code 
1106. 

Moreover, the seq_start_code 1106 defines the start of a 
new sequence of pictures, and the first data field 1103 and 
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the second data field 1105 carry data of a picture from a 
previous sequence. Thus, in accordance with the present 
invention the packet 1100 is processed by discarding the first 
data field 110 and the second data field 1105, and stuffing 

5 N+M dummy bytes in the adaptation field 1102. This results 
in the processed packet 1110 which includes the adaptation 
field 1112. The packet 1110 includes data from only one 
sequence of pictures and does not require the previous 
adjacent packet to maintain continuity. 

In FIG. 116, the unprocessed packet is shown generally at 
1120, and the processed packet is shown generally at 1130. 
Here, there is data between the adaptation_field 1102 and 
the pes_hdr 1104, but not between the pes_hdr 1104 and 
the seq_start_code 1106. In accordance with the present 
invention, the packet 1120 is processed by discarding the 

5 first data field 1103, and stuffing N dummy bytes into the 
adaptation field 1102. This results in the processed packet 
1130 which includes the adaptation field 1132. 

In FIG. 11c, the unprocessed packet is shown generally at 
1140, and the processed packet is shown generally at 1150. 

'J0 Here, there is data between the pes_hdr 1104 and the 
seq_start_code 1106, but not between the adaptation_field 
1102 and the pes_hdr 1104. In accordance with the present 
invention, the packet 1140 is processed by discarding the 
second data field 1105, and stuffing M dummy bytes in the 

!S adaptation field 1102. This results in the processed packet 
1150 which includes the adaptation field 1152. 

In FIG. lid, the unprocessed packet is shown generally at 
1160. Here, there is no data field between the pes_hdr 1104 
and the seq_start_code 1106, or between the adaptation_ 

o field 1102 and the pes_hdr 1104. In accordance with the 
present invention, the entire packet 1160 is transmitted 
without modification since there is no data field prior to the 
seq_start_code 1106. 
FIGS. 12a and 12b show a post-splicing data packet 

5 having an adaptation field but no PES header before and 
after processing in accordance with the present invention. In 
FIG. 12a, the unprocessed packet is shown generally at 
1200, and the processed packet is shown generally at 1210. 
Here, there is data between the adaptation field 1202 and the 

0 seq_start_code 1204. In accordance with the present 
invention, the packet 1200 is processed by discarding the 
first data field 1203 and stuffing N dummy bytes in the 
adaptation field 1202. This results in the processed packet 
1210 which includes the adaptation field 1212. 

5 In FIG. 12b, the unprocessed packet is shown generally at 
1220. Here, there is no data field between the adaptation 
field 1202 and the seq_start_code 1204. In accordance with 
the present invention, the entire packet 1220 is transmitted 
without modification since there is no data field prior to the 

o seq^start_code 1204. 

FIGS. 13a-13rf show a post-splicing data packet having 
no adaptation field but with a PES header before and after 
processing in accordance with the present invention. In FIG. 
13a, the packet, shown generally before processing at 1300, 

5 includes a transport header 1301, a first data field 1302 
carrying N bytes, a PES header 1303, a second data field 
1304 carrying M bytes, a sequence start code 1305 and a 
third data field 1306. In this case, it can be seen that there is 
data carried in the packet 1300 between the tp_hdr 1301 and 

D the pes_hdr 1303, and between the pes_hdr 1303 and the 
seq__start_code 1305. In accordance with the present inven- 
tion the packet 1300 is processed by discarding the first data 
field 1302 and the second data field 1304, and creating an 
adaptation field 1312 with N+M dummy bytes as shown in 

> the processed packet 1310. 

In FIG. 13b, the unprocessed packet is shown generally at 
1320, and the processed packet is shown generally at 1330. 
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Here, there is data between the tp__hdr 1301 and the 
pes_hdr 1303, but not between the pes_hdr 1303 and the 
seq_start_code 1305. In accordance with the present 
invention, the packet 1320 is processed by discarding the 
first data field 1302, and creating an adaptation field 1322 
with N dummy bytes, as shown in the processed packet 
1330. 

In FIG. 13c, the unprocessed packet is shown generally at 
1340, and the processed packet is showo generally at 1350. 
Here, there is data between the pes_hdr 1303 and the 
seq_start_code 1305, but not between the tp_hdr 1301 and 
the pes_hdr 1303. In accordance with the present invention, 
the packet 1340 is processed by discarding the second data 
field 1304, and creating an adaptation field 1352 with M 
dummy bytes, as shown in the processed packet 1350. 

In FIG. 13d, the unprocessed packet is shown generally at 
1360. Here, there is no data field between the tp_hdr 1301 
and the pes_hdr 1303, or between the pes_Jidr 1303 and the 
seq_start_code 1305. In accordance with the present 
invention, the entire packet 1360 is transmitted without 
modification since there is no data field prior to the seq_ 
start_code 1305. 

FIGS. 14a and 14b show a post-splicing data packet 
having no adaptation field or PES header before and after 
processing in accordance with the present invention. In this 
case, an adaptation field is created which carries the dummy 
stuffing bits which account for the discarded fields. In FIG. 
14<z, the unprocessed packet is shown generally at 1400, and 
the processed packet is shown generally at 1410. Here, there 
is data between the tp_hdr 1401 and the seq_start_code 
1403. In accordance with the present invention, the packet 
1400 is processed by discarding the first data field 1402, and 
creating an adaptation field 1412 with N dummy bytes, as 
shown in the processed packet 1410. 

In FIG. 146, the unprocessed packet is shown generally at 
1420. Here, there is no data field between the tp_hdr 1401 
and the seq_start_code 1403. In accordance with the 
present invention, the entire packet 1420 is transmitted 
without modification since there is no data field prior to the 
seq_start_code 1403. 

A decoder for decoding the output data stream may be 
provided as discussed earlier in connection with FIG. 1. For 
example, the Digital Entertainment Terminal (DET) 168 can 
include a decoder with an associated data buffer and pro- 
cessor. The buffer receives the incoming data stream and 
provides the data to the processor for decoding and other 
processing which is required to provide a signal suitable for 
reproduction on a television. As discussed, the provision of 
null packets in the output data stream will prevent a potential 
buffer overflow at the decoder. 

Accordingly, it can be seen that the present invention 
provides a method and apparatus for splicing compressed 
packetized digital video streams. In particular, a secondary 
packetized data stream, such as a commercial, is spliced 
with a primary packetized data stream, such as a network 55 
television program. The system does not require the decom- 
pression of the data in the primary data stream, and is 
particularly suitable for use at a cable system headend to 
allow the insertion of commercials from local businesses 
into a nationally broadcast television program. 60 

Although the invention has been described in connection 
with various specific embodiments, those skilled in the art 
will appreciate that numerous adaptations and modifications 
may be made thereto without departing from the spirit and 
scope of the invention as set forth in the claims. For 65 
example, it is possible to locate the IPU in the decoder at the 
subscriber's home, thereby providing the subscriber with the 
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capabilities of a in-home digital data mixer such as those 
used at television, radio and recording studios. This would 
allow the subscriber to edit various audio, video and data 
sources. For example, data stored on a DVD or CD-ROM 
could be spliced with a main program for various educa- 
tional and entertainment purposes. 
We claim: 

1. A method for splicing a secondary packetized data 
stream with a primary packetized data stream, comprising 
the steps of: 

providing a start signal indicating a time to initiate said 
splicing; 

determining a pre-splicing packet of said primary stream 
according to said start signal; 

providing an output stream where a first packet of said 
secondary stream is positioned to follow said prc- 
splicing packet; 

determining a post-slicing packet of said primary stream 
which follows said pre-splicing packet; 

discarding data of said pre-splicing packet which is asso- 
ciated with said post-splicing packet; and 

adding an amount of stuffing data to said pre-splicing 
packet according to the amount of data discarded. 

2. A method in accordance with claim 1, wherein the 
packets of said primary stream and said secondary stream 
have identifying data associated therewith, comprising the 
further steps of: 

retrieving said identifying data of said primary stream; 
and 

replacing said identifying data of said secondary stream 
with said identifying data of said primary stream. 

3. A method in accordance with claim 1, comprising the 
further steps of: 

providing a number Lof null packets in said output stream 
to prevent a buffer overflow at a decoder which receives 
said output stream; and 

inserting said null packets between said pre-splicing 
packet and said first packet; 

wherein said number L is determined according to respec- 
tive data rates of said primary and secondary streams 
and according to a decoding delay time of said decoder. 

4. A method in accordance with claim 2, wherein: 

the replaced identifying information of said secondary 
stream comprises at least one of program specific 
information (PSI) and packet identifier (PID) informa- 
tion. 

5. A method in accordance with claim 1, wherein said 
pre-splicing packet is a packet of said primary stream with 
an anchor frame start code which is closest to said start time. 

6. A method in accordance with claim 1, wherein said 
primary stream carries compressed digital data, and said 
splicing does not require decompression of said compressed 
digital data. 

7. A method in accordance with claim 1, wherein: 

the discarded data of said pre-splicing packet includes at 
least an anchor frame start code and a data field 
associated therewith. 

8. An apparatus for splicing a secondary packetized data 
stream with a primary packetized data, comprising: 

means for providing a start signal indicating a time to 

initiate said splicing; 
means for determining a pre-splicing packet of said 

primary stream according to said start signal; 
means for providing an output stream where a first packet 

of said secondary stream is positioned to follow said 

pre-splicing packet; 
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means for determining a post-splicing packet of said 

primary stream which follows said pre-splicing packet; 
means for discarding data of said pre-splicing packet 

which is associated with said post-splicing packet; and 
means for adding an amount of stuffing data to said 

pre-splicing packet according to the amount of data 

discarded. 

9. An apparatus in accordance with claim 8, wherein the 
packets of said primary stream and said secondary stream 
have identifying data associated therewith, further compris- 
ing: 

means for retrieving said identifying data of said primary 
stream; and 

means for replacing said identifying data of said second- 
ary stream with said identifying data of said primary 
stream. 

10. An apparatus in accordance with claim 9, wherein: 
the replaced identifying information of said secondary 

stream comprises at least one of program specific 
information (PS1) and packet identifier (PID) informa- 
tion. 

11. An apparatus in accordance with claim 8, further 
comprising: 

means for providing a number L of null packets in said 
output stream to prevent a buffer overflow at a decoder 
which receives said output stream; and 

means for inserting said null packets between said pre- 
splicing packet and said first packet; 

wherein said number Lis determined according to respec- 
tive data rates of said primary and secondary streams 
and according to a decoding delay time of said decoder. 

12. An apparatus in accordance with claim 8, wherein said 
pre-splicing packet is a packet of said primary stream with 
an anchor frame start code which is closest to said start time. 

13. An apparatus in accordance with claim 8, wherein: 
the discarded data of said pre-splicing packet includes at 

least an anchor frame start code and a data field 
associated therewith. 

14. An apparatus in accordance with claim 8, wherein said 
stuffing data is added to said pre-splicing packet in an 
adaptation field thereof, further comprising: 

means for creating said adaptation field if said adaptation 
field is not already present in said pre-splicing packet. 

15. A decoder for decoding a transport data stream which 
comprises a secondary packetized data stream which is 
spliced with a primary packetized data stream, wherein a 
first packet of said secondary stream is positioned to follow 
a pre-splicing packet of said primary stream, said decoder 
comprising: 

a buffer for storing said transport data; and 

a processor coupled to receive data from said buffer for 

processing said transport data; wherein: 
a number L of null packets are provided between said 

pre-splicing packet and said first packet to prevent 

overflow of said buffer; and 
said number L is determined according to respective data 

rates of said primary and secondary streams and 

according to a decoding delay time of said decoder. 

16. A method for splicing a secondary packetized data 
stream with a primary packetized data stream, comprising 
the steps of: 

providing a start signal indicating a time to initiate said 
splicing; 

determining a pre-splicing packet of said primary stream 
according to said start signal; 
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providing an output stream where a first packet of said 
secondary stream is positioned to follow said pre- 
splicing packet; 
determining a post-splicing packet of said primary stream 
which follows said pre-splicing packet; 

positioning said post-splicing packet to follow a last 
packet of said secondary stream in said output stream; 
discarding data of said post-splicing packet which is 
associated with a packet of said primary stream which 
precedes said post-splicing packet; and 
adding an amount of stuffing data to said post-splicing 
packet according to the amount of data discarded. 

17. A method in accordance with claim 16, wherein said 
15 post-splicing packet is a packet of said primary stream with 

a sequence start code which directly follows a sequence end 
code which is associated with said last packet of said 
secondary stream. 

18. A method in accordance with claim 16, wherein the 
packets of said primary stream and said secondary stream 
have identifying data associated therewith, comprising the 
further steps of: 

retrieving said identifying data of said primary stream; 
and 

replacing said identifying data of said secondary stream 
with said identifying data of said primary stream. 

19. A method in accordance with claim 18, wherein: 
the replaced identifying information of said secondary 

stream comprises at least one of program specific 
information (PSI) and packet identifier (PID) informa- 
tion. 

20. A method in accordance with claim 16, comprising the 
further steps of: 

providing a number L of null packets in said output stream 
to prevent a buffer overflow at a decoder which receives 
said output stream; and 
inserting said null packets between said pre-splicing 

packet and said first packet; 
wherein said number L is determined according to respec- 
tive data rates of said primary and secondary streams, 
and according to a decoding delay time of said decoder. 

21. A method in accordance with claim 16, wherein: 
said pre-splicing packet is a packet of said primary stream 

with an anchor frame start code which is closest to said 
start time. 

22. An apparatus for splicing a secondary packetized data 
stream with a primary packetized data stream, comprising: 

means for providing a start signal indicating a time to 

initiate said splicing; 
means for determining a pre-splicing packet of said 

primary stream according to said start signal; 
means for providing an output stream where a first packet 
of said secondary stream is positioned to follow said 
pre-splicing packet; 
means for determining a post-splicing packet of said 
primary stream which follows said pre-splicing packet; 
means for positioning said post-splicing packet to follow 
a last packet of said secondary stream in said output 
stream; 

means for discarding data of said post-splicing packet that 
is associated with a packet of said primary stream 
which precedes said post-splicing packet; and 
means for adding an amount of stuffing data to said 
post-splicing packet according to the amount of data 
discarded. 
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23. An apparatus in accordance with claim 22, wherein 
said post-splicing packet is a packet of said primary stream 
with a sequence start code which directly follows a sequence 
end code which is associated with said last packet of said 
secondary stream. 

24. An apparatus in accordance with claim 22, wherein 
the packets of said primary stream and said secondary 
stream have identifying data associated therewith, further 
comprising: 

means for retrieving said identifying data of said primary 
stream; and 

means for replacing said identifying data of said second- 
ary stream with said identifying data of said primary 
stream. 

25. An apparatus in accordance with claim 24, wherein: 
the replaced identifying information of said secondary 

stream comprises at least one of program specific 
information (PSI) and packet identifier (PID) informa- 
tion. 

26. An apparatus in accordance with claim 22, further 
comprising: 



.7,830 
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means for providing a number L of null packets in said 
output stream to prevent a buffer overflow at a decoder 
which receives said output stream; and 

means for inserting said null packets between said pre- 
5 splicing packet and said first packet; 

wherein said number L is determined according to respec- 
tive data rates of said primary and secondary streams, 
and according to a decoding delay time of said decoder. 

27. An apparatus in accordance with claim 22, wherein: 
said pre -splicing packet is a packet of said primary stream 

10 with an anchor frame start code which is closest to said 
start time. 

28. An apparatus in accordance with claim 8, wherein said 
primary stream carries compressed digital data, and said 
splicing does not require decompression of said compressed 

15 digital data. 

29. A method in accordance with claim 1, wherein said 
stuffing data is added to said pre-splicing packet in an 
adaptation field thereof, comprising the further step of: 

creating said adaptation field if said adaptation field is not 
2Q already present in said pre-splicing packet. 

***** 
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